Natural language processing in an intelligent writing strategy tutoring system.
نویسندگان
چکیده
The Writing Pal is an intelligent tutoring system that provides writing strategy training. A large part of its artificial intelligence resides in the natural language processing algorithms to assess essay quality and guide feedback to students. Because writing is often highly nuanced and subjective, the development of these algorithms must consider a broad array of linguistic, rhetorical, and contextual features. This study assesses the potential for computational indices to predict human ratings of essay quality. Past studies have demonstrated that linguistic indices related to lexical diversity, word frequency, and syntactic complexity are significant predictors of human judgments of essay quality but that indices of cohesion are not. The present study extends prior work by including a larger data sample and an expanded set of indices to assess new lexical, syntactic, cohesion, rhetorical, and reading ease indices. Three models were assessed. The model reported by McNamara, Crossley, and McCarthy (Written Communication 27:57-86, 2010) including three indices of lexical diversity, word frequency, and syntactic complexity accounted for only 6% of the variance in the larger data set. A regression model including the full set of indices examined in prior studies of writing predicted 38% of the variance in human scores of essay quality with 91% adjacent accuracy (i.e., within 1 point). A regression model that also included new indices related to rhetoric and cohesion predicted 44% of the variance with 94% adjacent accuracy. The new indices increased accuracy but, more importantly, afford the means to provide more meaningful feedback in the context of a writing tutoring system.
منابع مشابه
Do the Emotionally More Intelligent Gain More from Metacognitive Writing Strategy Training?
Though privileges ascribed to various facets of language learning strategy training have long been espoused with regard to varied language skills and components, the role some individual variables such as emotional intelligence might play in this respect seems to have received very scant attention. The researchers in the current study embarked on a probe into the impact of metacognitive strateg...
متن کاملAn initial framework of contexts for designing usable intelligent tutoring systems
The notion of context has been an issue of research in various aspects of intelligent systems such as knowledge management, natural language processing, reasoning and so on. This paper focuses on the various contexts surrounding the design and use of Intelligent Tutoring Systems (ITS) and proposes an initial framework of contexts by classifying them into three major groupings: interactional, en...
متن کاملNLP Techniques in Intelligent Tutoring Systems
Many Intelligent Tutoring Systems (ITSs) aim to help students become better readers. The computational challenges involved are (1) to assess the students’ natural language inputs and (2) to provide appropriate feedback and guide students through the ITS curriculum. To overcome both challenges, the following non-structural Natural Language Processing (NLP) techniques have been explored and the f...
متن کاملExpert Tutoring and Natural Language Feedback in Intelligent Tutoring Systems
Intelligent tutoring systems can provide benefits of one-on-one instruction automatically and cost effectively. To make the intelligent tutoring systems as effective as expert human tutors, my research aims at investigating what type of natural language feedback an intelligent tutoring system should provide and how to implement the feedback generation to engender significantly more learning tha...
متن کاملDeeper Natural Language Processing for Evaluating Student Answers in Intelligent Tutoring Systems
This paper addresses the problem of evaluating students’ answers in intelligent tutoring environments with mixed-initiative dialogue by modelling it as a textual entailment problem. The problem of meaning representation and inference is a pervasive challenge in any integrated intelligent system handling communication. For intelligent tutorial dialogue systems, we show that entailment cases can ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Behavior research methods
دوره 45 2 شماره
صفحات -
تاریخ انتشار 2013